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Abstract 

We propose a method to estimate the probability of new physics dis- 
covery in future high energy physics experiments. Physics simulation 
gives both the average numbers < N b > of background and < N s > 
of signal events. We find that the proper definition of the significance 
for < N b >, < N s > > 1 is S12 = sf< N s > + < N b > - V< N b > 

in comparison with often used significances Si = 6 — and S2 = 

V< N b > 

< N s > 

b We also propose a method for taking into ac- 

V< N s > + < N b > 

count the systematical errors related to nonexact knowledge of back- 
ground and signal cross sections. An account of such systematics is 
very essential in the search for supersymmetry at LHC. 
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1 Introduction 



One of the common goals in the forthcoming experiments is the search for 
new phenomena. In the forthcoming high energy physics experiments (LHC, 
TEV22, NLC, ...) the main goal is the search for physics beyond the Stan- 
dard Model (supersymmetry, Z'-, VF'-bosons, ...) and the Higgs boson dis- 
covery as a final confirmation of the Standard Model. In estimation of the 
discovery potential of the future experiments (to be specific in this paper we 
shall use as an example CMS experiment at LHC |M) the background cross 
section is calculated and for the given integrated luminosity L the average 
number of background events is < N b >= a b ■ L. Suppose the existence of 
a new physics leads to the nonzero signal cross section <r s with the same 
signature as for the background cross section that results in the prediction 
of the additional average number of signal events < N s >= a s ■ L for the 
integrated luminosity L. 

The total average number of the events is < N ev >=< N s > + < iVj >= 
(a s + <Tfc) • L. So, as a result of new physics existence, we expect an excess 
of the average number of events. In real experiments the probability of the 
realization of n events is described by Poisson distribution Q 

f(n,<n>) = ^^e-< n >. (1) 
n! 

Here < n > is the average number of events. 

Remember that the Poisson distribution /(n, < n >) gives || the proba- 
bility of finding exactly n events in the given interval of (e.g. space and time) 
when the events occur independently of one another and of x at an average 
rate of < n > per the given interval. For the Poisson distribution the vari- 
ance a 2 equals to < n >. So, to estimate the probability of the new physics 
discovery we have to compare the Poisson statistics with < n >=< N/, > 
and < n > = < Nf, > + < N s >. Usually, high energy physicists use the 
following "significances" for testing the possibility to discover new physics 
in an experiment: 

(a) "significance" Si 

(b) "significance" S2 

A conventional claim is that for Si (S2) > 5 we shall discover new 
physics (here, of course, the systematical errors are ignored). For iVj N s 



N b ^ 

N s 
VN S + N b 
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the significances S\ and S2 coincide (the search for Higgs boson through 
the H — > 77 signature). For the case when N s ~ iVj,, S± and S2 differ. 
Therefore, a natural question arises: what is the correct definition for the 
significance S±, S2 or anything else ? 

It should be noted that there is a crucial difference between "future" 
experiment and the "real" experiment. In the "real" experiment the total 
number of events N ev is a given number (already has been measured) and we 
compare it with < N[> > when we test the validity of the standard physics. 
So, the number of possible signal events is determined as N s = N ev — < Nb > 
and it is compared with the average number of background events < iVj, > . 
The fluctuation of the background is <jfb = VNb, therefore, we come to the 
Si significance as the measure of the distinction from the standard physics. 
In the conditions of the "future" experiment when we want to search for new 
physics, we know only the average number of the background events and 
the average number of the signal events, so we have to compare the Poisson 
distributions P(n, < Nf, >) and P(n, < iVj, > + < N s >) to determine the 
probability to find new physics in the future experiment. 

In this paper we estimate the probability to discover new physics in 
future experiments. We show that for < N s >, < >S> 1 the proper 
determination of the significance is S = \/<A r 5> + <A r 5> — yf< Nf, >. We 
also suggest a method which takes into account systematic errors related to 
nonexact knowledge of the signal and background cross sections. 

The organization of the paper is the following. In the next section we 
give a method for the determination of the probability to find new physics in 
the future experiment and calculate the probability to discover new physics 
for the given (< Nf, >, < N s >) numbers of background and signal events 
under the assumption that there are no systematic errors. In section 3 we es- 
timate the influence of the systematics related to the nonexact knowledge of 
the signal and background cross sections on the probability to discover new 
physics in future experiments. Section 4 contains the concluding remarks. 

2 An analysis of statistical fluctuations 

Suppose that for some future experiment we know the average number of the 
background and signal event < Nf, > , < N s > . As it has been mentioned in 
the Introduction, the probability of realization of n events in an experiment 
is given by the Poisson distribution 
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P(n,<n>) = -j- e~ <n> , (2) 

where < n >=< > for the case of the absence of new physics and 

< n >=< Nb > + < N s > for the case when new physics exists. So, to 
determine the probability to discover new physics in future experiment, we 
have to compare the Poisson distributions with < n >=< Nb > (standard 
physics) and < n > = < iV& > + < N s > (new physics). 

Consider, at first, the case when < Nb > S> 1, < N s > S> 1. In this 
case the Poisson distributions approach the Gaussian distributions 

1 (n-M) 2 

P G {n^,a 2 ) = —=-e , (3) 

civ2vr 

with /j, = a 2 and /i =< iVj, > or fi =< Nb > + < N s >. Here n is a real 
number. 

The Gaussian distribution describes the probability density to realize 
n events in the future experiment provided the average number of events 

< n > is a given number. In Fig.l we show two Gaussian distributions Pq 
with < n >=< N b >= 53 and < n >=< N b > + < N s > = 104 ([§, Ta- 
ble. 13, cut 6). As is clear from Fig.l the common area for these two curves 
(the first curve shows the "standard physics" events distribution and the 
second one gives the "new physics" events distribution) is the probability 
that "new physics" can be described by the "standard physics". In other 
words, suppose we know for sure that new physics takes place and the prob- 
ability density of the events realization is described by curve II (/2(x)). The 
probability k that the "standard physics" (curve I (fi(x))) can imitate new 
physics (i.e. the probability that we measure "new physics" but we think 
that it is described by the "standard physics" ) is described by common area 
of curve I and II. 

Numerically, we find that 
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exp[ 
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(4) 



<T2— 01 



Here u\ = y/Nl and a 2 = \/N b + N s . 
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As follows from formula (4) the role of the significance S plays 



5i2 = a 2 - ai = VN b + N s - y/N>. (5) 

Note that in refs.[|7]] the following criterion of the signal discovery has 
been used. The signal was assumed to be observable if (1 — e) • 100% upper 
confidence level for the background event rate is equal to (1 — e) • 100% 
lower confidence level for background plus signal (e = 0.01 — 0.05). The 
corresponding significance is similar to our significance S12. The difference is 
that in our approach the probability density k that new physics is described 
by standard physics is equal to 2e. 

It means that for S\2 = 1, 2, 3, 4, 5, 6 the probability k is correspondingly 
k = 0.31, 0.041, 0.0027, 6.3 • 10 ~ 5 , 5.7 • 10~ 7 , 2.0 • 10~ 7 in accordance with a 
general picture. As it has been mentioned in the Introduction two definitions 

of the significance are mainly used in the literature: Si = JL Q and S 2 = 



s = H . The significance S12 is expressed in terms of the significances 
V N s + N b 

o ac o S1S2 
bi and 62 as D12 



Si + S2 

For Nh S> N s (the search for Higgs boson through H — > 77 decay mode) 
we find that 



S12 ~ 0.5 Si « 0.5 S 2 . (6) 

It means that for Si = 5 (according to a common convention the 5a 
confidence level means a new physics discovery) the real significance is S12 = 
2.5, that corresponds to k = 1.2%. 

For the case N s = kN b , S12 = &12S2, where for k = 0.5, 1, 4, 10 the value 
of k 12 is fei2 = 0.55,0.59,0.69,0.77. For not too high values of < N b > 
and < N b + N s >, we have to compare the Poisson distributions directly. 
Again for the Poisson distribution P(n, < n >) with the area of definition 
for nonnegative integers we can define P(x,< n >) for real x as 

^» <»>) = { P([ x ],<n>), Ito. (7) 
It is evident that 

/oo 
P(x, < n >)dx = 1. (8) 
-00 
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So, the generalization of the previous determination of k in our case is 
straightforward, namely, k is nothing but the common area of the curves 
described by P(x, < N b >) (curve I) and P(x, < N b > + < N s >) (curve II) 
(see, Fig.2). 

One can find that [] 

K = Ki + K 2 , 



OC 



Kl= y (< N b>) n c -<N h > _ 1 r(n + l,<N b >) 



*2 = J2 



~. i n\ ' T(n + 1) 

n=no+l v ' 



;< iv 6 > + < iv s >) r 



e 



-(<Wi,>+<7V s >) 



n=0 n! 
r < ^ > i 



no "W+^) J - 

Numerical results are presented in Tables 1-6. 

As it follows from these Tables for finite values of < N s > and < N b > 
the deviation from asymptotic formula (4) is essential. For instance, for 
N s = 5, N b = 1 (Si = 5) k = 14%. For N s = N b = 25 (Si = 5) k = 3.9%, 
whereas asymptotically for N s 3> 1 we find k = 1.2%. Similar situation 
takes place for N s ~ A^. 



3 An account of systematic errors related to nonex- 
act knowledge of background and signal cross 
sections 

In the previous section we determined the statistical error k (the probability 
that "new physics" is described by "standard physics"). In this section we 
investigate the influence of the systematical errors related to a nonexact 
knowledge of the background and signal cross sections on the probability k 
not to confuse a new physics with the old one. 

Denote the Born background and signal cross sections as a® and a®. 
An account of one loop corrections leads to a b — ► <J b (l + 5\ b ) and a° s — > 
<Tg(l + Sis), where typically Si b and 8i s are 0(0.5). 

Two loop corrections at present are not known. So, we can assume that 
the uncertainty related with nonexact knowledge of cross sections is around 
Si b and Sis correspondingly. In other words, we assume that the exact cross 
sections lie in the intervals (a b ,a b (l + 25i b )) and (o"g,cr°(l + 2Si s )). The 
average number of background and signal events lie in the intervals 

x We are indented to Igor Semeniouk for the help in the derivation of these formulae 
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(<N°>,<N°>(l + 25 lh )) (9) 

and 

(<iV°>,<iV s > (1 + 2*1,)), (10) 
where < iV 6 ° >= a® ■ L, < iV s ° >= a° s ■ L. 

To determine the probability that the new physics is described by the old 
one, we again have to compare two Poisson distributions with and without 
new physics but in distinction from Section 2 we have to compare the Poisson 
distributions in which the average numbers lie in some intervals. So, a priori 
the only thing we know is that the average numbers of background and signal 
events lie in the intervals (9) and (10), but we do not know the exact values 
of < N b > and < N s >. To determine the probability that the new physics 
is described by the old, consider the worst case when we think that new 
physics is described by the minimal number of average events 

< N^ in >=< N? } > + < 7V° > . (11) 

Due to the fact that we do not know the exact value of the background 
cross section, consider the worst case when the average number of back- 
ground events is equal to < N b ° > (1 + 2Si b ). So, we have to compare the 
Poisson distributions with < n >=< N b ° > + < N® >= 

< N° > (1 + 26 lb ) + (< N° > -25 lb < >) and < n >=< > 
(1 + 2Sib). Using the result of the previous Section, we find that for case 
< iY 6 > > 1, < > > 1 the effective significance is 



Sns = V< ^6° > + < N2 > " V < N b >( 1 + 2S ^)- (12) 

For the limiting case S±b — > 0, we reproduce formula (5). For not too high 
values of < N® > and < N® >, we have to use the results of the previous 
section (Tables 1-6). 

As an example consider the case when 5u = 0.5, < N s >= 100, < >= 
50 (typical situation for sleptons search). In this case we find that 

Sl = = 14.1, 

V< N b > 

<N S > 



S 2 = ; = 8.2 

V < N s > + < N b > 

S12 = V< N b > + < N 8 > - V< N b > = 5.2, 
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S 12s = V< N b > + < N s > - ^/2<N b > = 2.25. 



The difference between CMS adopted significance S2 = 8.2 (that corre- 
sponds to the probability k = 0.206- 10 -6 ) and the significance S\2 S = 2.25 
taking into account systematics related to nonexact knowledge of back- 
ground cross section is factor 3.6 The direct comparison of the Poisson dis- 
tributions with < N b > (l + 2<5i 6 ) = 100 and < N b > (l + 2<5i 6 )+ < N s , eff > 
( < N s,eff >=< N s > -25 lb < N b >= 50) gives k s = 0.0245. 

Another example is with < N s >= 28, < Nb >= 8 and 5\ b = 0.5. For 
such example we have Si = 9.9, S 2 = 4.7, S 12 = 3.2, S 12s = 2.0, k s = 0.045. 

So, we see that an account of the systematics related to nonexact knowl- 
edge of background cross sections is very essential and it decreases the LHC 
SUSY discovery potential. 



4 Conclusions 

In this paper we determined the probability to discover the new physics in 
the future experiments when the average number of background < N b > 
and signal events < N s > is known. We have found that in this case for 
< N s > » 1 and < N b > » 1 the role of significance plays 

S 12 = V< N b > + < N s > - V< N b > 

in comparison with often used expressions for the significances Si = s = 

V< N b > 

<N S > 

and S 2 = - 1 ,r =- 

V< N s > + < N b > 

For < N s > < < N b > we have found that Si 2 = O.bSi = 0.5S 2 . 
For not too high values of < N s > and < N b >, when the deviations from 
the Gaussian distributions are essential, our results are presented in Tables 
1-6. We also proposed a method for taking into account systematical errors 
related to the nonexact knowledge of background and signal events. An 
account of such kind of systematics is very essential in the search for super- 
symmetry and leads to an essential decrease in the probability to discover 
the new physics in the future experiments. 

We are indebted to M.Dittmar for very hot discussions and useful ques- 
tions which were one of the motivations to perform this study. We are 
grateful to V.A.Matveev for the interest and useful comments. 
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Table 1: The dependence of k on < N s > and < N b > for S± = 5 



<N S > 


<N b > 


K 


5 


1 


0.1420 


10 


4 


0.0828 


15 


9 


0.0564 


20 


16 


0.0448 


25 


25 


0.0383 


30 


36 


0.0333 


35 


49 


0.0303 


40 


64 


0.0278 


45 


81 


0.0260 


50 


100 


0.0245 


55 


121 


0.0234 


60 


144 


0.0224 


65 


169 


0.0216 


70 


196 


0.0209 


75 


225 


0.0203 


80 


256 


0.0198 


85 


289 


0.0193 


90 


324 


0.0189 


95 


361 


0.0185 


100 


400 


0.0182 


150 


900 


0.0162 


500 


10 4 


0.0136 


5000 


10 6 


0.0125 



Table 2: The dependence of k on < N s > and < N b > for S2 ~ 5. 



< N s > 


<N b > 


K 


26 


1 


0.154 


10 


29 


4 


0.142 


10 


33 


9 


0.440 


10 


37 


16 


0.993 


10 


41 


25 


0.172 


10 


45 


36 


0.262 


10 


50 


49 


0.314 


10 


55 


64 


0.357 


10 


100 


300 


0.735 


10 


150 


750 


0.894 


10 
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Figure 1: The probability density functions fi, 2 (x) = Pg{ x , Hi, 2, °" 2 ) for 
Hi =< N b >= 53 and fi 2 =< N b > + < N s >= 104. 
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Figure 2: The probability density functions fi^x) = P(x,fi± t 2) for fi\ 
< N b > = 1 and ^ =< N b > + < N s >= 6. 
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Table 3: < N s >= -■ < N b >. The dependence of k on < N s > and 
5 

<N b >. 



<N S > 


<N b > 


K 


50 


250 


0.131 


100 


500 


0.033 


150 


750 


0.83- 10~ 2 


200 


1000 


0.24- 10~ 2 


250 


1250 


0.61 • 10~ 3 


300 


1500 


0.22 • 10~ 3 


350 


1750 


0.50 • 10~ 4 


400 


2000 


0.10- 10" 4 



Table 4: < N s >= — ■ < N b >. The dependence of k on < N s > and 
< N b >. 10 



< N s > 


< N b > 


K 


50 


500 


0.274 


100 


1000 


0.123 


150 


1500 


0.057 


200 


2000 


0.029 


250 


2500 


0.014 


300 


3000 


0.75 • 10~ 2 


350 


3500 


0.36-10- 2 


400 


4000 


0.20- 10~ 2 


450 


4500 


0.10- 10~ 2 


500 


5000 


0.50 • 10" 3 
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Table 5: < N s >=< N b >. The dependence of n on < N s > and < N b >. 



< N s > 


< N b > 


K 


2. 


2. 


0.562 


4. 


4. 


0.406 


6. 


6. 


0.308 


8. 


8. 


0.241 


10. 


10. 


0.187 


12. 


12. 


0.150 


14. 


14. 


0.119 


16. 


16. 


0.098 


18. 


18. 


0.079 


20. 


20. 


0.064 


24. 


24. 


0.043 


28. 


28. 


0.027 


32. 


32. 


0.018 


36. 


36. 


0.014 


40. 


40. 


0.84- 10~ 2 


50. 


50. 


0.33- 10~ 2 


60. 


60. 


0.13- 10~ 2 


70. 


70. 


0.47- 10~ 3 


80. 


80. 


0.16- 10~ 3 


100. 


100. 


0.30 • 10" 4 
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Table 6: < N s >= 2- < N b >. The dependence of n on < N s > and < N b >. 



<N S > 


<N b > 


K 


2. 


1. 


0.464 


4. 


2. 


0.295 


6. 


3. 


0.199 


8. 


4. 


0.143 


10. 


5. 


0.101 


12. 


6. 


0.074 


14. 


7. 


0.050 


16. 


8. 


0.038 


18. 


9. 


0.027 


20. 


10. 


0.020 


24. 


12. 


0.011 


28. 


14. 


0.60- 10~ 2 


32. 


16. 


0.35 • 10~ 2 


36. 


18. 


0.19- 10~ 2 


40. 


20. 


0.85 • 10~ 3 


50. 


25. 


0.27- 10~ 3 


60. 


30. 


0.40 • 10" 4 
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